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The First Generalized Speckle-Noise Pattern Reduction Method 
Of The Present Invention 

Prior to illumination of the target with the planar laser illumination beam 
(PLIB), modulate the spatial phase of the transmitted PLIB along the planar 
extent thereof according to a spatial phase modulation function (SPMF) so as 
to J 
produce numerous substantially different time-varying speckle-noise 
patterns at the image detection array of the BPD Subsystem during the photo- 
integration time period thereof* 



J 



r V>«. " 

I Temporally average the numerous substantially different time-varying 
speckle-noise patterns produced at the image detection array in the DFD \^-J£ 
Subsystem during the photo-integration time period thereof, so as to thereby 
reduce the power of the speckle-noise pattern observed at the image 
detection array. 
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The Second Generalized Speckle-Noise Pattern Reduction Method 
Of The Present Invention 



Prior to illumination of the target with the planar laser illumination beam 
(PLIB), modulate the temporal intensity of the transmitted PUB along the 
planar extent thereof according to a temporal intensity modulation function 
(TEMF) so as to 

produce numerous substantially different time-varying speckle- 
noise patterns at the image detection array of the EFD Subsystem during the 
photo-integration time period thereof. 

3, nz: 



Temporally average the numerous substantially different time-varying 
speckle-noise patterns produced at the image detection array in the IFD 
Subsystem during the photo-integration time period thereof, so as to thereby 
reduce power of the speckle-noise pattern observed at the image detection 
array. 
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Thfflb ^Generalized Speckle-Noise Pattern Redaction Method 
Of The Tresmt Invention 



Prior to illumination of the target with the planar laser illumination beam 
(PLIB), modulate the temporal f£**e of the transmitted PLEB afong-tfre 
p4««^rt«EDdfc^ew^ according to a fe^taL modulation function 

(TJMF) so as t<* 

produce numerous substantially different time-varying speckle- 
noise patterns at the image detection array of the IFD Subsystem during the 
photo-integration time period thereof. 



Temporally average the numerous substantially different time-varying 
speckle-noise patterns produced at the image detection array in the IFD 
Subsystem during the photo-integration time period thereof, so as to thereby 
reduce power of (he speckle-noise pattern observed at the image detection 
array. 
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J**<(k ^Generalized Speckle-Noise Pattern Reduction Method 
^ Of The Present fayention 



Prior to iHumination of the target with the planar laser illumination beam 
(PLIB), modulate the temporal |r*j£*rtxj of the transmitted PUB 

according to a temporal intensity modulation function 

(T MP) so as to i 

produce numerous substantially different time-varying speckle- 
noise patterns at the image detection array of the IFD Subsystem during the 
photo-integration time period thereof. 



Temporally average the numerous substantially different time-varying 
speckle-noise patterns produced at the image detection array in the IFD 
Subsystem during the photo-integration time period thereof, so as to thereby 
reduce power of the speckle-noise pattern observed at the image detection 
array* 
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filrt Generalized Speckle-Noise Pattern Reductio n Method 
~ Of The Present Invention 



Prior to illumination of the target with the planar laser illumination beam 
(PLIB), modulate the spatial intensity of the transmitted PLIB along the 
planar extent thereof according to a spatial intensity modulation function \ 
(SIMF) so as to : 

produce numerous substantially different time-varying speckle- 
noise patterns at the image detection array of the DPD Subsystem during the 
photo-integration time period thereof. 



Temporally average the numerous substantially different time-varying 
speckle-noise patterns produced at the image detection array in the IFD /& 
Subsystem during the photo-integration time period thereof, so as to thereby 
reduce power of the speckle-noise pattern observed at the image detection 
array. 
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^faft generalized SnecMe- Noise Pattern Redaction Method 
^* r>f The Present Invention 



After illumination of the target with the planar laser illumination beam 
(PLIB), modulate ttie spatial intensity of the reflected/scattered (i-e. received) 
PLIB along the planar extent thereof according to a spatial intensity J 
modulation function (SJMF) so as to 

produce numerous substantially different time- 
varying speckle-noise patterns at the image detection array of the IFD 
Subsystem during the photo-integration time period thereof. 



A 



^Temporally average the many substantially different time-varying speckle- 
noise patterns produced at the image detection array in the WD Subsystem 
during tiie photo-integration time period thereof; so as to thereby reduce the ^(2^ 
speckle-noise pattern observed at the image detection array. 



<$Jenl( k Generalized Speckle-Noise Pattern Redaction Method 
Of The Present Invention 



After illumination of th£ target with the planar laser illumination beam 
(PLIB), modulate th^ temporal intensity of the reflected/scattered (i.e. 
received) PLIB along the planar extent thereof according to a temporal 
v intensity modulation function (TIMF) so as to : 

. produce many substantially different 
time-varying speckle-noise patterns at the image detection array of the IFD 
Subsystem during the photo-integration time period thereof. , . 



Temporally average the many substantially different time-varying speckle- 
noise patterns produced at the image detection array in the IFD Subsystem 
during the photo-integration time period thereof, so as to thereby reduce the 
speckle-noise pattern observed at the image detection array. ^ 



to/ i«< 




EIGHT QEM5BAL1ZEQ M^THQP QF REWCjNG THE SPgCKLE PATTERN 
NOISE OBSERVED IN PLUM-BASED IMAGING SYSTEMS 



Use a PLIIM-BASED Imager to produce a series of consecutively 
captured digital images of an object over a series of photo-integration 
time periods of the PLHM-Based Imager, wherein each digital image of 

the object includes a substantially different speckle noise pattern 
produced by natural oscillatory micro-motion and/or forced oscillatory 
micro-movementof the Imager relative to the object during operation of 
the PLHM-Based Imager. 



B 



Store the series of consecutively captured digital images of the object in 
y buffer memory within the PLHM-Based Imager. 



Add relatively small (e.g. 3x3) windowed image processing filters to the 

additively combine and average the pixel data in the series of 
consecutively captured digital images so as to produce a reconstructed 
digital image having a speckle noise pattern with reduced RMS power. 



FIG.1I24D 
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NINTH GENERALIZED METHOD OF REDUCIN G SPECKLE PATTERN 
NOISE IN PLIIM-BASED IMAGIN G SYSTEMS 



During each photo-integration time period of a PLIIM-Based Imager, 
produce numerous substantially different spatially-varying speckle noise 
pattern elements (i.e. speckle noise pattern elements at different points) 

on each image detection element in the image detection array of the 

PLIIM-Based Imager. 



B 



/ 



Spatially (and temporally) average said spatially-varying speckle-noise 
pattern elements over the spatial area of each image detection element, 
thereby reducing the RMS power of speckle-pattern noise observed in 
said PLIM-Based Imager. 



FIG. 11241 
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Specify object detection and tracking capabilities of PLUM- based network , system, 

and/or subsystem. 



Specify object identification capabilities of PLJIM-based network , system, and/or 

subsystems. 



Specify object attribute acquisition capabilities of PLIIM-based network, system, and/ 

or subsystem. 


v 


i 


Determine the configuration of hardware components required to build the configured 

system or network. 


\ 


f 


Determine the configuration of software components required to build the configured 

system or network. 


\ 


f 


The system configuration manager program accesses the determined software 
components from its Software Library (e.g. maintained on an information server within 
the system engineering department), and compiles these software components with all 
other required software programs, to produce a complete System Software Package 
designed for execution upon a particular operating system supported upon the 
specified hardware configuration. 


\ 


f 



The systems configuration manager program automatically generates an easy-to- 
follow set of Installation Instructions for the configured system or network, guiding the 
technician through an easy to follow installation and set-up procedures making sure all 
of the necessary system and subsystem hardware components are properly installed, 
and system and network parameters set up for proper system operation and remote 

servicing. 



Once the hardware components of the system have been properly installed and 
configured, the set up procedure properly completed, the technician is ready to 
operate and test the system for troubles it may experience, and diagnose the same 

with or without remote service assistance made available through the remote 
monitoring, configuring, and servicing system of the present invention, illustrated in 

Figs. 30A through 30D2 
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PLLEM-BASED PACKAGE IDENTIFICATION AND 
DIMENSIONING (PID) SYSTEM 



Image Processing Computer 
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LD1P Package 
Dimensioner with 
Integrated Package 






Autc-Focus/Auto-Zbom 
Digital Camera 








Velocity Detection 






Camera Control Con^uter 
Subsystem 

(Bgs.24A,24B, 25,26, 27, 
2S,29) 
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Package 
Velocity 


Real-Tlme'Package Height 
Profiling and Edge- 
Detection Processing 
Module 

(Figs. 21, 22, 23) 
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\ LDIP Subsystem (122) 



FIG. 14 



LDIP REAL-TIME PACKAGE HEIGHT PROFILE AND 
EDGE DETECTION METHOD 



A — Raw data is received every 5ms; plus tirac stamp 



B — 



C - 



D — 



Convert raw data into range profile 

RafQnt phase]* referenced with respect to Polar 

Coordinate System symbolically embedded in 



Use Geometric transformations 

hp] * RKJsin(ang - 90) and 

x[I] * R[i]tan(ang - 90) to convert range profile 

RffJ into height hp] and position xpj data. 



Obtain ourent package height by fiatfing 
prevailing hd&txt using edge detection without 
filtering (Rg. 16). 



Find the coordinates of the left and right edges of 
package 0J% RFE) by searching for fee closest 
coordinates from the edges of the belt (X,, X»J 
toward the center thereof. 



Analyze intensity data values {R(nt» and 
determine the X coordinate position range X 41> 
X^tJnR global) where the height intensity 
changes 0) within the spatial bounds (X^ X^g) 
and 00 beyond predetermined height intensity 
data thresholds* 



Create time-stamped data set {X^ h, X^, V B , 
nT} by assembling package left-edge coordinate 
(LPS), current package height (h% package right 
edge coordinate (RPE), X coordinate subrange 
where height values exhibit maximum intensity 
changes* package velocity (VjX and time stamp 



£ _ Send hextuple data set to camera control 



LDIP Package Diraensionerwim Integrated Velocity 
DetecUon 



Real-time Package 
Height Profiling and 
Edge Detection 
Processing Module 



belt velocity 



to 



Fig. 15 



LDIP Real Time Package Edge Detection 




Xa« location of bdt left edg^ Xb«locat5a?i oHwlt rigbt edge 

UPE«Leftpwte«c edge; B?E~Ki^padage edge 
HQ *Kx^ height anay; Xp -* Xfoel location wriiy 
win = package detectum window 



R5. /6 




Fig. 17 



INFORMATION MEASURED AT SCAN ANGLES BEFORE 
COORDINATE TRANSFORMS 



a, = a a 



li,0, ^ 



















Fig. 17A 



RANGE AND POLAR ANGLE MEASURES TAKEN AT SCAN 
ANGLE a BEFORE COORDINATE TRANSFORMS 



Range aod Polar 




0 
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Fig. 17B 



MEASURED PACKAGE HEIGHT AND POSHION VALUES 
AFTER COORDINATE TRANSFORMS 



H[] 

Input height after 
coordinate transforms 




height value y^) and 
position value xCctj) 
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CAMERA CONTROL PROCESS CARRIED OUT WITHIN THE CAMERA 
CONTROL SUBSYSTEM OF EACH OBJECT IDENTIFICATION AND 
ATTRIBUTE , A CQUISITION SYSTEM OF PRESE NT INVENTIO N 

Start 



i 



Camera Control Computer receives a time-stamped quintuple Data Set (i,e. coordinate 
of Left Package Edge, coordinate of Right Package Edge, height, velocity, and time 
stamp) from the LDIP Subsystem and stores the Data Set in a Package Data Buffer 
Structure having N«5 columns and M rows; Camera Control Computer optical power 

(milliwatts) which each PLIA must produce (using method in Figs. 18C), and transmits 
the computer optical power to each PLIA and dependent system. 


« — 1 
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Camera Control Computer analyzes height data in the Package Data Buffer and detects 
the occurrence of detecting discontinuities, and based on such detected height 
discontinuities, determines the corresponding coordinate position of the leading 
package edges by ieft-most and right-most coordinate values associated with the data 
set at this detected height discontinuity. 


© 



Camera Control Computer determines the height of the package 
qA associated with the leading package edges determined at Block B above. 



N 



Camera Control 
Computer transforms 
the position of left and 
right package edge 
(LPE, RPE) coordinates 
buffered in the deepest 
row of the Data Package 
Buffer at which the 
height value was 
determined at Block D 
to a Global Coordinate 

Reference System 
symbolically embedded 
in the conveyor belt 
structure beneath the 
LDIP Subsystem, as 
shown in Fig. 17. 



Camera Control Computer 
analyzes the height values 
(i.e. coordinates) computed 
over previous raw data set 

processing cycles, and 
stored in the Package Data 
Buffer, and determines the 
"median" height of 
package, as well as the 
average "slope" of the 
package's laser scanned 
surface. 



A 



K 



Camera Control 
Computer analyzes 
height value in the 
Package Data 

Buffer, and 
determines the 
speed of the 
package (V b (t)). 
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FIG. 18A 
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Camera Control Computer detects the x- 
coordinates of the package boundaries based 
on the spatlafly-transformed coordinate values 
of the left and right package edges (LPE, 
RPE) buffered in the Package Data Buffer. 



Based on x-coordinates of the detected 
package boundaries (and optionally, the 
subrange of x-coordlnates over which 
maximum range "fntensfty" data variations 
have been detected by the lens data of Fig. 
15) determined at block O, the Camera 
Control Computer determines the 
corresponding pixel Indices (i, j) in the Image 
Buffer which specify the image frame (i.e. 
region of Interest) to be cropped from the 
image(s) to be subsequently captured by the 
!FD Subsystem. 



Camera Control Computer uses Focus/Zoom 

Lookup Table in Fig. 21 to determine the 
focus and zoom lens group positions based 
on the height of the package determined at 
block D. 



Camera Control Computer transmits Lens 
Group Moves Commands to the IFD 
Subsystem. 



IFD Subsystem uses the Lens Group 
Movement Commands to move the lens 
groups to their desired positions. 



H 



Camera Control Computer checks 
resulting positions of moved lens 
groups. 



Camera Control Computer corrects lens 
group positions. 




Camera Control Computer uses the 
computed values of median package height, 
belt speed and the Photo-Integration Time 
Lookup Table in Fig. 23 to determine the 
photo-integration time parameter which will 

ensure that 'square* image pixels are 
produced in captured package images (i.e. 
pixels having a 1:1 ratio); Camera Control 
Computer also uses (I) computed belt speed/ 
velocity, (II) the pre-specified image resolution 
(dpi), and (ili) computed "slope" of laser 
scanned surface so as to compute the 
surface-slope compensated Line Rate of the 

IFD subsystem mat helps ensure that 
captured linear images have substantially 
constant pixel resolution (dpi) independent of 

the angular arrangement of the package 
surface during surface profiling and Imaging 
operations. 



Camera Control Computer generates digital 
control signals for the compute parameters- 
Photo-Integration Time Period and 
Compensated Line Rate- and thereafter 
transmits these digital control signals to the 
CCD image detection array in the IFD 
Subsystem. 



Camera Control Computer uses package 
«me-stamp (nT) and package velocity (V ) to 
determine the "Start Time" of image Frame 
Capture (STIC) 



i 



Camera Control Computer uses 0) the Start 
Time of Image Capture (STIC) determined at 
Block Q, to generate a command for starting 
Image Frame Capture, and also uses (ii) the 
pixel indices (l,J) determined at Block P to 
generate commands for cropping the 
corresponding slice of the "region of interest" 
in the image being captured and buffered in 
the Image Buffer within the IFD Subsystem. 



^1 



Camera Control Computer transmits the 
command generated at Block R to the IFD 
Subsystem. 



FIG. 18B 



METHQD QF QQMPMTINe QPT1QAL OUTPUT POWER FROM CASE 
DIODES IN PLANAR LASER 1LUM1NAT1QN ARRAY (PL1A1 FOR 
QONTRQLL1NQ CONSTANT WHIT E IEVEL IN IMAGE PIXELS CAPTURED 
BY PUlM-BAggDUNgAP IMAQER 



Compute the Line Rate of Linear Image Detection Array (dots/sec) 
based on computed Belt Velocity (inches/sec) and constant Image 
Resolution (dots/inch) desired, using equation: 

Line Rate = (Belt Velocity) x (Image Resolution) 



B" 



Compute the Photointegration Time M of the Linear Image 
Detection Array based on the computed Line Rate using the 

formula: 



Photointegration Time Period - 1/Line Rate 



© 



FIG. 18C1 



0 



Compute the Optical Power (milliwatts) of each PL1A based on computed 
Photointegration Time Period (AT) using the following formula: 



Optical Power of VLD (milliwatts) « 



constant 



Photointegration Time Period AT 



FIG. 18C2 
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METHOD OF COMPUTING COMPENSATED LINE RATE FOR CORRECTING 
V1EW1NG-ANGLE DISTORTION OCCUR1NG IN IMAGES OF OBJECT 
SURFACES CAPTURED AS OBJECT SURFA CES MOVE PAST PLUM- 
BASED LINEAR 1MAQ5R AT NON-ZERO SKEWED ANQLE 



Compute the Line Rate of Linear Image, Image Detection Array 
(dots/sec) based on computed Belt Velocity (inches/sec) and 
constant Image Resolution (dots/inch) desired, using equation: 

Line Rate s (Belt Velocity) x (image Resolution) 



Compute the Line Rate Compensation factor cosine (6 or 0), where 
6 and 0 is defined in Figs. 18E1 and 18E2 respectively as the 

computed average scope of the packages surface laser scanned by 
the AM laser beams powered by the LDiP subsystem, and is 
computed at Block D in Fig. 18A. 



Compute the Compensated Line Rate for the IFD (i.e. camera) 
subsystem using the equation: 

Compensated Line Rate = (Line Rate) x Cos(6)) 



FIG. 18D 
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Top Down Imaaina 
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CASE 2: 

side imaging 



Coplanar 
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FIG. 18E2 



X coordinate subrange where 
maximum range "intensity" 
variations have been detected 



Left Package 
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Fig. 20 
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METHOD OF AND APPARATUS FQR PERFORMIN G AUTOMATIC 
RTOQNIT1QN OF QRAPHICAl UmUQEMfiE CONTAINED IN 2-D 
(MAQEg CAPTUREQ FROM AR B1TARY 3-D QBJgQT SURFACES 



STEP 1 : At the unitary PLIIM-based object imaging and profiling system, 
use the laser doppler imaging and profiling (LDIP) subsystem employed 
therein to (i) consecutively capture a series of linear 3-D surface profile 
maps on a targeted arbitrary (e.g. non-planar or planar) 3-D object 
surface bearing forms of graphical intelligence and (ii) measure the 
velocity of the arbitrary 3-D object surface, wherein the polar coordinates 
of each point in the captured linear 3-D surface profile map are specified 
in a local polar coordinate system RtDtP/poiar* symbolically embedded 
within the LDIP subsystem. 



J. 



STEP 2: At the unitary PLIIM-based object imaging and profiling system, 
use coordinate transforms to automatically convert the polar coordinates 
of each point p(a, R) in the captured linear 3-D surface profile map into 
x,y, z Cartesian coordinates specified as p(x,y,z) In a local Cartesian 
coordinate system RLDiP/Cartesian > symbolically embedded within the LDIP 
subsystem. 



I 



STEP 3: At the unitary PLHM-based object imaging and profiling system, 
use the PLIIM-based imager employed therein to consecutively capture 
high-resolution linear 2-D images of the arbitrary 3-D object surface 
bearing forms of graphical intelligence (e.g. symbol character strings), 
wherein (i) the x 1 , y coordinates of each pixel in each said captured high- 
resolution linear 2-D image is specified in local Cartesian coordinate 
system R puiM/cartesian symbolically embedded within the PLIIM-based 
imager, and (ii) the intensity value of the pixel \{x\tf) is associated with the 
x\ y 1 Cartesian coordinates of the image detection element in the linear 
image detection array at which the pixel is detected, and (iii) wherein also 
the planar laser illumination beam (PUB) of the PLIIM-based imager is 
spaced from the amplitude modulated (AM) laser scanning beam of the 
LDIP subsystem is about D centimeters. 



FIG. 23C1 
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STEP 4: At the unitary PLIIM-based object imaging and profiling system, 
capture and buffer the camera (1FD) parameters used to form and detect 
each linear high-resolution 2-D image captured during the corresponding 
photo-integration time period AT K , by the PLIIM-based imager. 



STEP 5: At the end of each photo-integration time period AT K , use the 
unitary PLUM-based object imaging and profiling system to transmit the 
following information elements to the Image Processing Computer for 
data storage and subsequent information processing: 

(1) the converted coordinates x, y, z, of each point in the linear 3- 
D surface profile map of the arbitrary 3-D object surface captured during 
photo-integration time period AT K ; 

(2) the measured velocity(ies) of the arbitrary 3-D object surface 
during photo-integration time period AT K ; 

(3) the x\ y 1 coordinates and intensity value I(x'y) of each pixel in 
each high- resolution linear 2-D image captured during photo-integration 
time period DTk and specified in the local Cartesian coordinate system 

ftpuiM/Carteslan \ and 

(4) the captured camera (IFD) parameters used to form and detect 
each linear high-resolution 2-D image captured during the photo- 
integration time period AT K 



STEP 6: At the Image Processing Computer, receive the data elements 
transmitted from the PLIIM-based profiling and imaging system durin Step 
5, buffer data elements (1) and (2) in a first FIFO buffer memory structure, 
and data elements (3) and (4) in a second FIFO buffer memory structure. 



FIG. 23C2 
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STEP 7: At the Image Processing Computer, use the x,y, z coordinates 
associated with a consecutively captured series of linear 3-D surface 
profile maps (i.e. stored in first FIFO memory storage structured order to 
construct a 3-D polygon-mesh surface representation of said arbitrary 3-D |^-G 
object surface, represented by Su>ip(x,y l z) and having (i) vertices 
specified by x,y, z in local coordinate reference system Rpufwcartesian , and 
(ii) planar polygon surface patches Sj(x,y,z) and being defined by a set of 
said vertices. 



STEP 8: At the Image Processing Computer, convert the x',y\z' 
coordinates of each vertex in the 3-D polygon-mesh surface 
representation into the local Cartesian coordinate reference system 
R f=n.»iwcart«sian symbolically embedded within the PUIM-based imager. 



+1 



STEP 9: At the Image Processing Computer, specify the x! f y\ i 
coordinates of each i-th planar polygon surface patch s(x,y,z) represented 
in the local Cartesian coordinate reference system RpuiM/cartestan* so as to 
produce a set of corresponding polygon surface patch {s i (x , ,y , ,z , )J 
represented in system RpuiM/cartesfen 



STEP 10: At the Image Processing Computer, for a selected linear high- 
resolution 2-D image captured at photo-integration time period AT K , and 
spatially corresponding to one of the linear 3-D surface profile maps 
employed at Step 7, use the camera (IFD) parameters used and recorded 
(i.e. captured) during the corresponding photo-integration time period in 
order to construct a 3-D vector-based H pixel ray" model specifying the 
optical formation of each pixel in the linear 2-D image, wherein a pixel ray 
reflected off a point on the arbitrary 3-D object surface is focused through 
the camera's image formation optics (i.e. configured by the camera 
parameters) and is detected at the pixel's detection element in the linear 
image detection array of the IFD (camera) subsystem. 



FIG. 23C3 
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STEP 1 1 : At the Image Processing Computer, for each laser beam ray 
{producing one of the pixels in said selected linear 2-D image), (i) 
determine which polygon surface patch Sj(x, y, z) the pixel ray intersects, 
(ii) compute the x,y, z coordinates of the point of intersection (POI) 
between the pixel ray and the polygon surface patch represented in 
Cartesian coordinate reference system RpuiM^artes/an * 0«) designate 
the computed set of points of intersection as {p f (x,y,z)}. 



STEP 12: At the image Processing Computer, for each laser beam ray 
passing through a determined polygon surface patch s(x',y\ z') at a 
computed point of intersection p ? (x, y, z), assign the intensiiy value Hx'y) 
of the pixel ray to the x 1 , y\ z' coordinates of the point of intersection, 
thereby producing a linear high-resotution 3-D image comprising a 2-D 
array of pixels, each said pixel pixel having as its attributes (i) an Intensity 
value Kx'YjZ') and (ii) coordinates x\ y\ t specified in the local Cartesian 
coordinate reference system RpLUM/cartesian- 



T 



STEP 13: Put the computed linear high-resolution 3-D image in a third 
FIFO memory storage structure in the image processing computer. 



T 



STEP 14: Repeat Steps 1-6 to update the first and second FIFO data 
queues maintained in the image processing computer, and Steps 7-13 to J^N 
update the consecutively computed linear high-resolution 3-D image 
stored in the third FIFO memory storage structure. 



STEP 15: Assemble in an image buffer in the image processing 
computer, a set of consecutively computed linear high-resolution 3-D 
images retrieved from the third FIFO data storage device so as to 
construct an "area-type" high-resolution 3-D image of said arbitrary 3-D 
object surface. 



FIG. 23C4 




STEP 16: At the Image Processing Computer, map the intensity value 
l(x f , y 1 , z s ) of each pixel in the computed area-type 3-D image onto the 
x'y.z' coordinates of the points on a uniformly-spaced apart "grid" 
positioned perpendicular to the optical axis of the camera subsystem (i.e. 
to model the 2-D planar substrate on which the forms of graphical 
intelligence was originally rendered), wherein said mapping process 
involves using an intensity weighing function based on the x\ y 1 , z' 
coordinate values of each pixel in the area-type high-resolution 3-D 
image, thereby producing an area-type high-resolution 2-D image of the 
2-D planar substrate surface bearing said forms of graphical intelligence 
(e.g. symbol character strings). 



STEP 17: At the Image Processing Computer, use said OCR algorithm to 
perform automated recognition of graphical intelligence contained in said 
area-type high-resolution 2-D image of said 2-D planar substrate surface 
so as to recognize said graphical intelligence and generate symbolic 
knowledge structures representative thereof. 



i 



STEP 18: Repeat Steps 1-17 as often as required to recognize changes [^-R 
in graphical intelligence on the arbitrary moving 3-D object surface. 



FIG. 23C5 
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Specify object detection and tracking capabilities of PLUM- based network , system, 

and/or subsystem. 



V 



Specify object identification capabilities of PLHM-based network , system, and/or 

subsystems. 



Specify object attribute acquisition capabilities of PLIIM-based network, system, and/ 

or subsystem. 


\ 


f 


Determine the configuration of hardware components required to build the configured 

system or network. 


\ 


f 


Determine the configuration of software components required to build the configured 

system or network. 


\ 


f 


The system configuration manager program accesses the determined software 
components from its Software Library (e.g. maintained on an information server within 
the system engineering department), and compiles these software components with all 
other required software programs, to produce a complete System Software Package 
designed for execution upon a particular operating system supported upon the 
specified hardware configuration. 


\ 





The systems configuration manager program automatically generates an easy-to- 
follow set of Installation Instructions for the configured system or network, guiding the 
technician through an easy to follow installation and set-up procedures making sure all 
of tiie necessary system and subsystem hardware components are properly installed, 
and system and network parameters set up for proper system operation and remote 

servicing. 



Once the hardware components of the system have been properly installed and 
configured, the set up procedure properly completed, the technician is ready to 
operate and test the system for troubles it may experience, and diagnose the same 
y\ with or without remote service assistance made available through the remote 
H monitoring, configuring, and servicing system of the present invention, illustrated in 

Figs. 30A through 30D2 
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FIG. 25C 
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Use an Internet-enabled client computer to establish a network 
connection (via network router) with an HTTP server in the tunnel- 
based LAN requiring remote monitoring, control and/or service. 



±. — 

Use an Internet-enabled client computer to access an RMCS 
management console (GUI) from the HTTP server and display the 

same. 



Use the RMCS management console to display network 
configuration parameters in the tunnel-based LAN, and to use these 
network configuration parameters to monitor configuration 
parameters and performance parameters of each system in the 

network. 

l 



Use the RMCS management console to monitor the configuration 
and other monitorable parameters of each subsystem in the system. 



Use the RMCS management console to run a diagnostic program to 
trouble shoot any performance problems with the system. 



Using information collected by the diagnostic program and the 
RCMS management console, reconfigure selected parameters in 
the system and instruct any hardware repairs that may be required 

at the LAN location. 



FIG. 30D1 * 
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Use the RMCS management console to rerun diagnostic programs 
on troubled systems and subsystems in the LAN after parameter 
reconfiguration and/or hardware repair at the LAN location, so as to 
test the performance of such systems and subsystems and the 
overall tunnel based LAN. 



it- 



Use the RMCS management console to monitor parameters of the 
system and subsystems in the tunnel based LAN, from time to time, 
to determine whether or not the system 
and/or network tunnel is required. 



v 



Use the RMCS management console to record ail monitored 
parameter records and result of diagnostic programs in a customer 
service database for future reference, and access during 
subsequent remote service calls over the Internet. 



FIG. 30D2 



For each package transported through tunnel system, master unit (with package dimensioning 
subsystem aid velocity detection subsystem) generates package height, width, length and 
velocity data {ftWJUV}^ referenced with respect to global coordinate reference system 
Rgbtei> ^ transmits such package dimension data to each slave unit downstream, using the 
system's data communications network. 



T 

Each slave unit receives the transmitted package height, width and length data {H,W£,V } G 
and converts this coordinate information into the slave unit's local coordinate reference system 



The camera control computer in each slave unit uses the converted package height; width, 
length data {H,WJL}j and package velocity data to generate camera control signals tor driving 
the camera subsystem in the slave unit to zoom and focus in on the transported package as it 
moves by the slave unit, while ensuring that captured images having substantially constant 
OPX Resolution and 1:1 aspect ratio. 



HG.32A 




Each slave unit captures images acquired by its intelligently controlled camera subsystem, 
buffers the same, and processes the images to decode barcode symbol identifiers represented 
in said images, and/or to perform optical character recognition (OCR) thereupon. 



The slave unit which decodes a bar code symbol in a processed image automatically transmits 
a package identification data element (containing symbol character data representative of the 
decocted barcode symbol) to the master unit (or other designated system control unfc 
employing data efement management functionalities) for package data element processing. 



Master unit time-stamps received package identification data element, places said data 
element in a data queue, and processes package identification data elements and time-stamped 
package dimension data elements in said queue to link each package identification data 
element with one said corresponding package dimension data element 
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Each passenger who is about to board an aircraft at an airport, would first go to 
check-in station with personal identification (e.g. passport, drivers license, national 
identification card, etc.) in hand, as well as with articles of baggage to be carried on 
board the aircraft by the passenger. 



Upon checking in with this station, the Passenger Identftcation (PID) Bar Code 
Symbol And Baggage Identification (BID) Bar Code Symbol Dispensing Subsystem 
issues (1 ) a passenger identification bracelet bearing (or otherwise encoded with) a 
PID bar code symbol, and (2) a corresponding PID bar code symbol for attachment to 
each package carried on the aircraft by the passenger. At the same time, this 
subsystem creates, for each passenger and set of baggage checked into the system at 
the check-in station, a passenger/baggage information record in the Passenger and 
Baggage Attribute RDBMS. 



1 


r 


The passenger identification (PID) bracelet (or identification badge) is affixed to the 
passenger s person at the passenger check-in station which is to be worn during the 
entire duration of the passenger s scheduled flight. 




f 



The PLHM-Based Passenger Identification And Profiling Camera Subsystem at the 
passenger check-in station automatically captures (i) a digital image of the 
passenger s face, head and upper body, (ii) a digital profile of his or her face and head 
(and possibly body) using the LDIP subsystem employed therein, and (iii) a digital 
image of the passengers identification card(s). Other biometric information 
acquisition devices provided at 'the passenger check-in station can be used to acquire, 
from each passenger ehecking-in, passenger attribute information (e.g. retinal pattern 
information, fingerprint pattern information , voice pattern information, facial pattern 
information, DNA pattern information) to assist in die reliable identification of the 
passenger. 



Each item of passenger attribute information acquired at the passenger check-in 
station is co-indexed with the corresponding passengsr identification (PID) number, 
and stored in the information records maintained in the Passenger and Baggage 
Attribute RDBMS, subsequent information processings 



Each BID bar coded article of baggage is conveyed through the tunnel-type package 
Identification, dimensioning and tracking subsystem installed before the entry port of 
the X-racGation baggage scanning subsystem (or integrated theiewithin), and is then 
conveyed through the X-radiatk>n baggage scanning subsystem* As this scanning 
process occurs, each bar coded article of baggage is automatically identified, imaged, 
and dimensioned/profiled by package identification, dimensioning and tracking 
subsystem and then imaged by x-radtatbn scanning subsystem. 



Each item of baggage attribute information acquired at the baggage check-in station is 
co-indexed wim the corresponding baggage identification (BID) number, and stored 
in the information records maintained in the Passenger and Baggage Attribute 
RDBMS, subsequent information processing. 



Each BID bar coded article of baggage is conveyed through a second tunnel-type 
package identification, dimensioning and tracking subsystem installed downstream, 
before the entry port of the automated explosive detection subsystem EDS (or 
integrated therewithin), and is then conveyed through the EDS. 



At the EDS station, each bar coded article of baggage is automatically identified, 
imaged, and dimensioned/profiled by package identification, dimensioning and 
tracking subsystem and then analyzed by EDS. 



Each item of baggage attribute information acquired at the EDS station is co- 
indexed wim the corresponding baggage identification (BID) number, and stored in 
the information records maintained in the Passenger and Baggage Attribute 
RDBMS, subsequent information processing. 



jfo?/ its 

Conventional methods of detecting suspicious conditions revealed by x-ray images of 
baggage can be used (e,g. using an x-ray image monitor adjacent the x-ray scanning 
subsystem) 



Intelligent information processing algorithms can be used to automatically operate on 
each passenger and baggage attribute record stored in the Passenger and Baggage 
Attribute RDBMS 



Passenger attribute information stored in remote intelligence RDBMSs can be 
accessed and used with passenger and baggage attribute information is me Passenger 
and Baggage Attribute RDBMS in order to detect any suspicious conditions which 
may given concern or alarm about either a particular passenger or article of baggage 
presenting concern or abreach of security. 



Such post-check-in information processing operations can also be carried out on 
passenger and/or baggage attribute information stored in the Passenger and Attribute 
RDBMS and/or in remote intelligence RDBMSs on a wide aiea network (WAN) or 
local area network (LAN) with human assistance, if necessary, to determine if a 
breach of security appears to have occurred. 



If a breach is determined prior to flight-time, then the flight related to the suspect 
passenger and/or baggage mfeht be aborted with the use of security personnel 
signaled by subsystem. If a breach is detected after an aircraft has lifted off, then the 
flight crew and pilot can be informed by radio communication of the detected 
security concern. * 



Each passenger who is about to board an aircraft at an airport, would first go to 
check-in station with personal identification (e.g. passport, drivers license, national 
identification card, etc.) in hand, as well as wife articles of baggage to be carried on 
board the aircraft by the passenger. 



B 



Upon checking in with this station, the Passenger Identification (PID) Bar C6de 
Symbol And Baggage Identification (BID) Bar Code Symbol Dispensing Subsystem 
issues (I ) a passenger identification bracelet bearing (or otherwise encoded with) a 
PID bar code symbo 1* and (2) a corresponding PID bar code symbol for attachment to 
each package carried on the aircraft by the passenger. At the same time, this 
subsystem creates, for each passenger and set of baggage checked into the system at 
the check-in station, a passenger/baggags information record in the Passenger and 
Baggage Attribute RDBMS. 
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The passenger identification (PID) bracelet (or identification badge) is affixed to the 
passenger s person at the passenger check-in station which is to be worn during the 
entire duration of the passenger s scheduled flight. 
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The PLIIM-Based Passenger Identification And Profiling Camera Subsystem at the 
passenger check-in station automatically captures (i) a digital image of the 
passenger s face, head and upper body, (ii) a digital profile of his or her face and head 
(and possibly body) using the LDEP subsystem employed therein, and (in) a digital 
image of the passenger s identification card(s). Oiherbiometric information 
acquisition devices provided at fee passenger check-in station can be used to acquire, 
from each passenger checking-in, passenger attribute information (e.g, retinal pattern 
information, fingerorint pattern information, voice pattern information, facial pattern 
information, DNA pattern information) to assist in the tellable identification of the 



._ J 

Each item of passenger attribute information acquired at the passenger check-in 
station is co-indexed with the corresponding passenger identification (PID) number, 
and stored in the information records maintained in the Passenger and Baggage 
Attribute RDBMS, subsequent information processing. 



Each BID bar coded article of baggage is conveyed through the tunnel-type package 
identification, dimensioning and tracking subsystem installed before the entry port of 
the X-radiation baggage scanning subsystem (or attegrated thetewithin), and is then 
conveyed through the X-radiation baggage scanning subsystem. As this scanning 
process occurs, each bar coded article of baggage is automatically identified* imaged, 
and dimensioned/profiled by package identification, dimensioning and tracking 
subsystem and then imaged by x-radiation scanning subsystem. 



Each item of baggage attribute information acquired at the baggage check-in station is 
co-indexed with the corresponding baggage identification (BID) number, and stored 
in the information records maintaiaed in the Passenger and Baggage Attribute 
RDBMS, subsequent information processing. 



Each BID bar coded article of baggage is conveyed through a second tunnel-type 
package identification, dimensioning and tracking subsystem installed downstream, 
before the entry port of the automated explosive detection subsystem EDS (or 
integrated merewithin), and is then conveyed through the EDS, 



At tike EDS station, each bar coded article of baggage is automatically identified, 
imaged, and dimensioned/profiled by package identification, dimensioning and 
tracking subsystem and then analyzed by EDS. 



t 

Each item of baggage attribute information acquired at the EDS station is co- 
indexed with the corresponding baggage identification (BID) number, and stored in 
the information records maintained in the Passenger and Baggage Attribute 
RDBMS, subsequent information processing. 



Conventional methods of detecting suspicious conditions revealed by x-ray images of 
baggage can be used (e.g. using an x-ray image monitor adjacent the x-ray scanning 
subsystem) 



Intelligent information processing algorithms can be used to automatically operate on 
each passenger and baggage attribute record stored in the Passenger and Baggage 
Attribute RDBMS 



Passenger attribute information stored in remote intelligence RDBMSs can be 
accessed and used with passenger and baggage attribute information in the Passenger 
and Baggage Attribute RDBMS in order to detect any suspicious conditions which 
may given concern or alarm about either a particular passenger or article of baggage 
presenting concern or a breach of security. 



Such post-check-in information processing operations can also be carried out on 
passenger and/or baggage attribute information stored in the Passenger and Attribute 
RDBMS and/or in remote intelligence RDBMSs on a wide area network (WAN) or 
local area network (LAN) with human assistance, if necessary, to determine if a 
breach of security appears to have occurred. 



If a breach is determined prior to flight-time, men the flight related to me suspect 
passenger and/or baggage might be aborted with the use of security personnel 
signaled by subsystem. If a breach is detected after an aircraft has lifted off, then die 
flight crew and pilot can be informed by radio communication of the detected 
security concern. 
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